Tracking Facial Motion

نویسندگان

  • Irfan A. Essa
  • Trevor Darrell
  • Alex Pentland
چکیده

We describe a computer system that allows real-time tracking of facial expressions. Sparse, fast visual measurements using 2-D templates are used to observe the face of a subject. Rather than track features on the face, the distributed response of a set of templates is used to characterize a given facial region. These measurements are coupled via a linear interpolation method to states in a physically-based model of facial animation, which includes both skin and muscle dynamics. By integrating real-time 2D image-processing with 3-D models, we obtain a system that is able to quickly track and interpret complex facial motions.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Analysis and Synthesis of Facial Expressions by Feature-Points Tracking and Deformable Model

Face expression recognition is useful for designing new interactive devices offering the possibility of new ways for human to interact with computer systems. In this paper we develop a facial expressions analysis and synthesis system. The analysis part of the system is based on the facial features extracted from facial feature points (FFP) in frontal image sequences. Selected facial feature poi...

متن کامل

A Piecewise Bézier Volume Deformation Model and Its Applications in Facial Motion Capture

Capturing real facial motions from videos enables automatic creation of dynamic models for facial animation. In this paper, we propose an explanation-based facial motion tracking algorithm based on a piecewise Bézier volume deformation model (PBVD). The PBVD is a suitable model both for synthesis and analysis of facial images. With this model, basic facial movements, or action units, are first ...

متن کامل

Chapter 8 FACIAL MOTION CAPTURING USING AN EXPLANATION-BASED APPROACH

Building deformation models using the motions captured from real video sequences is becoming a popular method in facial animation. In this paper, we propose an explanation-based facial motion tracking algorithm based on a piecewise Bézier volume deformation model (PBVD). The PBVD is a suitable model both for the synthesis and the analysis of facial images. It is linear and independent of the fa...

متن کامل

Facial tracking with head pose estimation in stereo vision

Facial tracking is a key step for face modeling, coding and animation. In this paper we present a robust method of facial tracking in stereo vision. We use an efficient representation of 3-D face motion, consisting of global head motion and local facial deformation. Stereo vision is utilized to measure 3-D coordinates of the face, the global and local motion parameters of the tracked face is so...

متن کامل

Facial feature tracking combining model-based and model-free method

In this paper we propose a novel facial feature tracker, which integrates model-free and model-based method to reliably track dense facial features with complex non-rigid motions in low quality video sequence. The tracker consists the mouth motion model part and the enhanced KLT tracker part. There are three key elements in our algorithms: dense facial feature tracking, noise removal with globa...

متن کامل

Facial features motion analysis for wire-frame tracking in model-based moving image coding

This paper addresses the problem of wire-frame tracking by accurate analysis of the motion and the shape of the facial features in head-and-shoulders scenes. Accurate wire-frame tracking is of paramount importance for correct reconstruction of the encoded image, especially in the areas occupied by the lips and the eyes. An entirely new algorithm for tracking the motion of a semantic wire-frame ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1994